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I.  INTRODUCTION 


Preventing  failures  in  high  performance  aircraft  engines  and  reciprocating  engines 
due  to  foreseeable  problems  is  a  common  sense  pan  of  the  armed  services  mandatory 
safety  programs.  These  programs  call  for  regular  maintenance  to  be  done  to  decrease 
the  opportunities  for  equipment  failure.  Through  various  programs  it  was  found  that 
some  failure  types  can  be  anticipated  by  using  spectrometers  to  trace  wearmetal 
contamination  levels  over  time  in  used  oil  samples.  The  actions  taken  based  on  the 
analysis  of  data  resulted  in  savings  from  reduced  failures  and  decreased  maintenance  on 
items  that  were  not  in  need  of  scheduled  periodic  maintenance. 

The  main  spectrometric  device  currently  in  use  by  the  armed  services  is  the 
A  E35L-3.  It  is  a  bulky,  heavy  instrument  that  is  not  easily  transportable  to 
deployment  locations.  A  newer  device,  the  Portable  Wear  Metal  Analyzer,  has  been 
designed  to  fill  the  need  of  a  'deployable'  oil  analyzer.  Its  production  model 
distribution  is  scheduled  to  commence  in  the  fall  of  1987.  The  nature  of  the  two 
instruments  causes  them  to  produce  differing  measurements  of  the  contaminant 
wearmetals  in  oil  samples.  The  differences  are  primarily  due  to  their  differing  physics 
and  engineering  design. 

The  measurement  differences  are  important  to  those  units  deployed  with  a 
Portable  Wear  Metal  Analyzer.  Users  of  either  instrument  rely  on  the  Joint  Oil 
Analysis  Program  Laboratory  Manual  [Ref.  1]  which  is  based  on  A/E35U-3 
measurements.  The  oil  analyst  uses  the  manual  for  three  primary  purposes:  to 
compare  wearmetal  values  obtained  with  the  wearmetal  evaluation  criteria  and  trend 
tables;  to  obtain  information  from  the  table  providing  decision  making  guidance;  and 
to  obtain  supplemental  information  providing  additional  wearmetal  diagnostic  guidance 
for  each  type  of  equipment  evaluated.  Therefore  to  use  the  manual  properly,  the 
analyst  must  have  the  same  type  values  as  the  technical  manual.  Through 
transformation  equations  to  be  produced  in  this  paper,  the  Portable  Wear  Metal 
Analyzer  user  will  be  able  to  convert  technical  manual  values  to  those  that  are 
consistent  with  it.  As  usage  of  the  new  instrument  increases,  the  benefits  of  including 
separate  wearmetal  evaluation  criteria  and  trend  tables  based  on  the  Portable  Wear 
Metal  Analyzer  measurements  will  become  increasingly  apparent. 


An  analytical  development  of  transformation  equations  between  the  Portable 
Wear  Metal  Analyzer  and  the  A/E35U-3  will  be  presented  in  this  paper.  It  will  be 
supported  by  a  background  of  the  oil  analysis  program,  descriptions  of  the  two  oil 
analysis  instruments,  and  a  discussion  of  the  data  available.  The  methodology  of  the 
analysis  and  a  description  of  the  models  used  to  arrive  at  the  final  conclusions  of  what 
transformation  equations  are  required  to  translate  technical  manuals  from  A/E35U-3 
values  to  Portable  Wear  Metal  Analyzer  values  will  be  given. 


II.  OIL  ANALYSIS  PROGRAM 


A.  BACKGROUND 

For  several  years,  the  Spectrometric  Oil  Analysis  Program  (SOAP)  has  been  in 
use  by  all  three  military  services.  The  Navy  started  a  trial  program  in  1956  to 
determine  if  spectrometric  analysis  of  oil  samples  could  be  used  to  predict  engine 
failures.  The  success  of  the  trial  program  led  to  the  Navy  Oil  Analysis  Program 
(NOAP).  The  inter-service  importance  of  oil  analysis  was  seen  and  culminated  in  the 
1976  merger  of  the  Army,  Navy,  and  Air  Force  programs  into  the  Joint  Oil  Analysis 
Program  (JOAP). 

Of  many  statements  made  on  the  purposes  of  the  Joint  Oil  Analysis  Program, 
Thomas  Menard  provides  one  that  is  simple  and  concise.  He  states  that  the  purpose  is 
to  provide  a  continual  monitoring  of  the  amounts  of  wearmetal  contaminants  found  in 
engine  oil  as  an  indicator  of  engine  wear  and  possible  engme  failure  (Ref.  2:  p.  1].  The 
program  technical  manual  defines  the  Joint  Oil  Analysis  Program  as:  The  Army,  Navy, 
Air  Force ,  Marine  Corps  coordinated  effort  to  develop  a  standardized,  mutually  beneficial 
program  to  determine  equipment  wear  condition  through  the  use  of  oil  analysis  [Ref.  1:  p. 
1-3). 

The  armed  services  were  long  under  a  preventive  maintenance  program  which 
involved  set  maintenance  at  specific  intervals.  Although  these  programs  were 
successful,  they  were  costly  both  in  terms  of  excessive  time  and  costs  of  periodically- 
replaced  maintenance  items.  Within  the  world  of  lubricated  engines,  this  meant  an 
aircraft  or  vehicle  might  unnecessarily  be  taken  out  of  service  for  maintenance.  In 
response  to  this,  on-condition  or  reliability  centered  maintenance  was  developed.  At 
the  heart  of  this  maintenance  idea  is  the  performance  of  maintenance  tasks  as  required, 
vice  the  arbitrarily  set  interval  schedule.  The  end  result  is  increased  time  between 
maintenance  actions.  Senholzi  [Ref.  3:  p.  18]  addressed  the  benefits  of  increased 
intervals  to  include  reduced  maintenance  costs,  reduced  equipment  downtime,  and 
reduced  safety  hazards  that  may  occur  between  maintenance  intervals.  The  nature  of 
the  oil  analysis  program  ideally  suits  itself  to  this  modem  approach  to  maintenance. 

The  oil  analysis  program  uses  used  oil  samples  for  testing  and  thereby  is  able  to 
non-destructively  monitor  the  apparent  contaminant  content  in  a  lubricating  system. 


This  is  done  by  measuring  the  wearmetal  concentrations  of  certain  key  elements  within 
an  oil  sample.  The  current  values  of  this  wearmetal,  and  the  recent  trend  of  those 
values  are  important  in  ascertaining  the  possible  condition  of  a  system.  Through  the 
use  of  the  applicable  technical  manual,  high  levels  and  problem  trends  may  be 
discovered.  Determination  of  what  action  is  to  be  taken  and  areas  to  check  or 
continue  to  monitor  are  recommended  by  the  technical  manual.  Unfortunately,  the  oil 
analysis  program  is  not  a  cure-all  and  will  not  discover  every  type  of  failure  or 
guarantee  to  find  a  problem  trend  every  time. 

The  oil  analysis  program  has  vastly  increased  over  the  years  as  economics  and 
costly,  sensitive  components  have  played  larger  roles.  Currently,  the  primary  oil 
analysis  instrument  is  the  A/E35U-3  (hereafter  called  the  Dash-3).  It  is  in  use 
worldwide  by  the  armed  services  and  other  groups,  and  plays  a  large  role  in  the 
maintenance  previously  described.  This  is  demonstrated  by  the  1.5  million  samples 
analyzed  per  year  by  the  100  plus  Air  Force  JOAP  laboratories  alone  [Ref.  4],  Due  to 
its  weight,  size,  and  supporting  peripherals  required,  the  Dash-3  is  normally  used  in 
stationary  laboratories  (including  aircraft  carriers). 

In  many  areas,  and  for  many  engine  types,  the  need  for  analysis  is  immediate  in 
order  to  keep  planes  in  the  air  and  vehicles  on  the  road.  Restrictions  on  program 
usefulness  are  therefore  evident  if  oil  samples  were  required  to  be  shipped  to  distant 
laboratories  for  analysis  and  have  the  corresponding  delay  in  return  of  the  subsequent 
results.  The  resulting  requirements  for  a  transportable  oil  analysis  machine  led  to  the 
Portable  Wear  Metal  Analyzer  (hereafter  called  the  PWMA).  It  is  a  lightweight 
instrument  that  is  easily  transported  utilizing  two  small  cases.  Its  design  makes  it  ideal 
for  units  that  are  deployed  away  from  a  nearby  JOAP  laboratory  and  which  still  need 
quick,  reliable  results.  In  the  following  sections,  the  principles  of  operation  of  both 
instruments  will  be  discussed. 

B.  DISCUSSION  OF  INSTRUMENTS  USED  IN  ANALYSIS 

The  measurements  of  two  different  types  of  spectrometers  are  compared  in  this 
analysis.  The  difference  in  their  measurements  is  rooted  in  the  different  physical 
principals  they  employ,  atomic  emission  and  atomic  absorption  spectrometry.  The 
following  is  provided  as  background  for  the  physical  concepts  and  uses  of  these  two 


instruments. 


1.  A/E35U-3 

The  A/E35U-3  (Dash- 3)  fluid  analysis  spectrometer  is  the  standard  instrument 
for  the  Joint  Oil  Analysis  Program  today.  It  is  an  atomic  emission  spectrometer  and  is 
manufactured  by  the  Baird  Corporation  of  Bedford,  Massachusetts.  It  is  a  self- 
contained  unit  that  weighs  800  pounds  and  has  dimensions  of  60  x  52.5  x  49.5  inches. 
Within  its  shipping  container,  it  weighs  1400  pounds  and  has  dimensions  of  74  x  67  x 
47.75  inches  [Ref.  1:  p.4-2].  The  instrument  has  the  capability  of  measuring  twenty 
elements  within  an  oil  sample.  These  twenty  elements  are  listed  in  Table  1  .  The 
measurement  of  all  elements  is  accomplished  simultaneously. 

TABLE  1 

ELEMENTS  MEASURED  BY  THE  A/E35U-3 

Fe  Iron  Na  Sodium  Ba  Barium 

Ag  Silver  Ni  Nickel  Cd  Cadmium 

Ar  Aluminum  Pb  Lead  Mn  Manganese 

Be  Bervllium  Si  Silicon  Mo  Molybdenum 

Cr  Chromium  Sn  Tin  V  Vanadium 

Cu  Copper  Ti  Titanium  Zn  Zinc 

Mg  Magnesium  B  Boron 

Atomic  emission  spectrometers  are  optical  type  instruments  used  to  determine 
the  concentration  of  wearmetals  in  lubricating  fluid.  The  analysis  is  accomplished  by 
subjecting  ("burning")  the  sample  to  a  high  voltage  spark  which  energizes  the  atomic 
structure  of  the  metallic  elements,  causing  the  emission  of  light.  Within  the  Dash-3, 
this  is  done  through  the  use  of  a  rotating  disk  electrode  spark  source.  The  light  is 
caused  by  the  atomic  structures  of  the  elements  being  excited  into  higher  energy  states 
by  the  high  temperature  and  then  returning  to  their  ground  state  through  the  emission 
of  light.  One  or  more  characteristic  wavelengths  may  be  given  off  by  each  element. 
The  emitted  light  is  subsequently  focused  into  the  optical  path  of  the  spectrometer  and 
separated  according  to  wavelength,  converted  to  electrical  energy  and  then  measured. 
The  emitted  light  for  any  element  is  proportional  to  the  concentration  of  wearmetal 
suspended  in  the  lubricating  fluid.  This  makes  possible  the  estimates  for  the  wearmetal 
concentration  levels  for  each  element  that  are  normally  measured  in  parts  per  million 
(ppm).  [Ref.  1,5:  pp.  2-1,  21] 

The  final  values  obtained  from  a  spectrometer  are  subject  to  many  sources  of 
error.  Several  of  these  sources  apply  to  both  the  Dash-3  and  the  PWMA.  Some  of  the 
reasons  for  error  and  factors  that  may  influence  the  actual  value  obtained  are  given 
below' [Ref.  1:  pp.  2-3, 2-4]: 


•  Oil  sample  from  wrong  component 

•  Contaminating  substances  in  system 

•  Oil  is  not  homogeneous  in  content 

•  Type  of  instrument  being  used,  emission  or  absorption  spectrometer 

•  Contaminated! poor  quality  calibration  standards 

•  Changes  of  rod  or  disc  electrodes  without  restandardizing  equipment 

•  Metallic  components  in  fluid  additives  within  oil  manufacture 

•  Electrolytic  corrosion  due  to  seasons,  storage 

•  Dirt  and  sand  contamination 

•  Metal  content  of  the  fuel 

•  Break-in  period  of  new  or  recently  overhauled  components 

Another  possible  problem  source  is  that  of  using  synthetic  ester  oil  to 
calibrate  the  instrument.  Rhine  [Ref.  6:  p.  39]  found  this  to  directly  effect  the  Dash-3 
by  the  enhancement  of  emission  from  metals  in  an  ester  oil  matrix  relative  to  metals  in  a 
hydrocarbon  matrix.  The  end  product  of  this  is  superficially  high  readings  from  the 
ester  oil  when  calibration  is  done  with  a  hydrocarbon  oil.  Similarly,  problems  are 
introduced  by  calibrating  an  instrument  using  standards  prepared  in  a  synthetic  oil 
matrix.  Specific  to  the  Dash-3  design,  errors  may  be  introduced  if  there  are 
inefficiencies  in  the  particle  transport  capability  of  the  rotating  disk  electrode,  or  in  the 
vaporization  and  excitation  of  those  transported  particles  at  the  arc/ spark  source 
[Ref.  6:  p.  53].  A  study  for  the  Air  Force  by  United  Technologies  Corporation  placed 
some  of  the  precision  problems  of  the  Dash-3  on  the  variable  excitation  characteristics 
of  direct  current  ( dc )  arcs  operated  in  air,  inaccuracies  due  to  variations  in  sample 
viscosity,  and  the  inability  to  analyze  particles  larger  than  10  micrometers  in  size 
[Ref.  7:  p.l]. 

2.  PWMA 

The  Portable  Wear  Metal  Analyzer  (PWMA)  is  planned  as  the  standard 
instrument  for  deployments  to  remote  areas  where  the  Dash-3  is  not  located  or 
suitable.  It  is  a  graphite  furnace  atomic  absorption  spectrometer  manufactured  by  the 
Perkin-Elmer  Corporation's  Applied  Science  Division  of  Pomona,  California.  It  is 
composed  of  two  self-contained  units  that  double  as  shipping  containers.  The  units  are 


lightweight,  weighing  60  pounds  and  40  pounds  respectively,  and  have  identical 
dimensions  of  11  x  18  x  18  inches  (Ref.  8:  p.  1-4].  The  instrument  has  the  capability  of 
measuring  nine  elements  within  an  oil  sample,  these  elements  are  listed  in  Table  2  . 
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The  measurements  of  all  elements  is  accomplished  simultaneously.  The  instrument  has 
repeatability  specifications  of  +/-  lppm  or  +  /-  2.5%  of  full  scale,  whichever  is  greater. 

TABLE  2 

ELEMENTS  MEASURED  BY  THE  PWMA 

Fe  Iron  Cr  Chromium  Ni  Nickel 

A*z  Silver  Cu  Copper  Si  Silicon 

Af  Aluminum  Mg  Magnesium  Ti  Titanium 

Atomic  absorption  spectrometers  are  similar  to  their  emission  counterparts  in 
being  optical  type  instruments  used  to  determine  the  concentration  of  wearmetals  in  a 
lubricating  fluid.  However,  the  physical  concepts  of  the  machines  are  very  different. 
With  the  atomic  absorption  spectrometer,  the  atomic  structures  of  the  elements  present 
become  energized  enough  by  high  temperatures  to  absorb  light  (rather  than  emit  light 
as  in  the  Dash-3).  Within  the  PWMA,  the  heating  is  done  in  a  graphite  furnace  tube 
whereas  other  atomic  absorption  spectrometers  usually  use  a  flame.  The  graphite 
furnace  atomic  absorption  spectrometer  uses  the  graphite  tube  as  a  resistive  heating 
element  to  atomize  the  wearmetals.  Light  energy  having  the  same  ("characteristic") 
wavelength  of  the  element  being  analyzed  is  then  radiated  through  the  graphite  tube. 
Two  multi-element  hollow-cathode  lamps  are  used  for  this  in  the  PWMA.  The 
resultant  light  is  converted  to  electrical  energy  and  measured  electronically  by  using 
photomultiplier  detectors.  The  amount  of  light  energy  absorbed  by  the  elements  in  the 
optical  path  of  the  graphite  tube  is  proportional  to  the  concentration  of  wearmetal 
suspended  in  the  lubricating  fluid.  This  makes  possible  the  estimates  for  the  wearmetal 
concentration  levels  for  each  element  that  are  normally  measured  in  parts  per  million. 
The  after  to  before  ratio  of  light  intensities  that  is  used  makes  the  signal  less 
susceptible  to  intensity  variations  of  the  spectra  caused  by  the  environment. 
[Ref.  1,4:  pp  2-2,6] 

Six  prototype  PWMA  instruments  were  acquired  by  the  Air  Force  for  testing 
in  an  operational  environment  with  military  personnel  as  operators  [Ref.  9:  p.  2].  Field 
test  plans  were  developed  by  the  Air  Force  Wright  Aeronautical  Laboratories 
(AFWAL).  As  part  of  this  plan,  instruments  were  provided  to  four  locations  to  be 
used  alongside  the  Dash-3.  Locations  in  receipt  of  these  instruments  were:  Naval  Air 
Rework  Facility  (NARF),  Pensacola;  Elmendorf  AFB;  Langley  AFB;  and  Myrtle  Beach 
AFB.  Preliminary  testing  on  a  prototype  PWMA  showed  it  to  be  successful  in 


measuring  particles  up  to  20  micrometers  in  size  [Ref.  4:  p.  60].  The  prototype 
PWMA's  currently  use  preprogrammed  algorithms  in  calibrating  themselves.  This  is 
done  using  three  successive  calibration  runs.  The  runs  specify  three  points  for  each 
element's  calibration  curve  algorithm  and  may  result  in  small  inaccuracies.  Further 
areas  of  possible  error  are  described  in  Reference  4  . 

Initial  testing  of  the  PWMA  has  shown  it  to  yield  values  that  are 
approximately  one-half  of  those  obtained  with  the  Dash-3.  For  example,  a  sample  that 
measures  11  ppm  on  the  Dash-3  may  only  measure  6  ppm  on  the  PWMA.  The 
wearmetal  concentration  level  (in  ppm)  is  readily  seen  from  this  to  depend  on  which 
instrument  is  used.  Investigation  of  this  point  shows  the  controlling  factor  to  be  in 
whether  the  measurement  is  based  on  atomic  emission  (as  with  the  Dash-3),  or  based 
on  atomic  absorption  (as  with  the  PWMA).  This  difference  in  using  light  emission  or 
light  absorption  for  estimating  an  element  concentration  level  leads  to  the  separate 
scales  obtained. 


III.  DATA 


A.  FIELD  USE  OF  JOAP  DATA 

Once  values  have  been  obtained  from  an  oil  analysis  spectrometer,  an  analyst 
must  be  able  to  do  more  than  add  them  to  a  database.  His  primary  goal  is  to 
determine  if  there  is  any  abnormal  condition  present  or  developing  in  the  parent 
component  of  the  sample.  This  goal  may  be  achieved  by  following  the  wearmetal 
methodology  presented  by  the  JO  A  P  Laboratory  Manual.  The  major  parts  of  the 
method  are  [Ref.  1:  p.6-1]: 

•  a  wearmetal  evaluation  and  trend  table 

•  a  table  providing  decision  making  guidance 

•  supplemental  information  providing  additional  wearmetal  diagnostic  guidance  for 
each  type  of  equipment  evaluated 

When  consumption  and  replenishment  of  fluid  is  continuously  balanced  in  a 
component,  the  wearmetal  concentration  within  the  lubricant  tends  to  increase  after  a 
fluid  change  until  a  steady  state  level  is  achieved.  This  effect  is  shown  in  Figure  3.1  . 
The  wearmetal  concentration  steady  state  point  in  this  model  is  thus  a  function  of  two 
variables:  rate  of  fluid  consumption  and  replenishment;  and  the  rate  of  wearmetal 
production  by  internal  friction  within  the  equipment.  When  the  fluid  is  added  or 
changed  periodically,  as  is  done  with  many  items  of  equipment,  a  sawtooth  pattern 
emerges.  Such  a  pattern  is  shown  in  Figure  3.2  .  [Ref.  1:  pp.  2-5,6] 

Because  of  a  tendency  toward  a  steady  state  level,  it  is  not  only  important  to 
know  the  actual  wearmetal  concentration,  but  also  to  know  the  rate  of  increase  (trend) 
of  that  concentration.  Increased  sampling  is  always  recommended  as  levels  increase  in 
order  to  decrease  the  probability  of  a  wearmetal  concentration  going  from  normal  to 
abnormal  without  an  intermediate  sample.  The  exact  procedure  the  oil  analysts  are 
trained  to  follow  in  evaluating  a  sample  is  a  logical  sequence  of  actions.  The  JOAP 
manual  mandates  the  following  procedure  [Ref.  1:  p.  6-2]: 

•  Analyze  the  sample  and  obtain  the  wearmetal  concentration  results. 

•  Determine  the  range  where  each  critical  wearmetal  falls  from  the  appropriate 
wearmetal  evaluation  criteria  and  trend  table. 

•  Compare  the  wearmetal  concentration  ranges  of  the  current  sample  with  the 
ranges  of  the  last  previous  sample. 

•  Determine  the  wearmetal  trend  ( trend  value  for  a  ten  hour  period). 


If  a  maintenance  action  is  indicated,  consult  the  supplemental  information 
provided. 


Figure  3.1  Theoretical  Concentration  with  Constant  Fluid  Replenishment. 


Figure  3.2  Concentration  with  Periodic  Fluid  Addition  or  Change' 


Table  3  [Ref.  1:  pp.  98.9*J|  is  provided  to  gain  a  Fuller  understanding  oF  the  oil 
analysts  procedure.  It  pros  ides  the  wearmetal  evaluation  criteria  and  trend  table  For 
the  164  series  engine  commonly  used  in  the  C11-53A,  D  helicopter.  A  sample  scenario 
would  show  the  analyst  checking  lor  a  normal  trend  by  comparing  the  current  values 
with  those  oF  the  previous  sample,  and  then  checking  For  to  see  if  the  current  values  are 
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in  a  normal  range.  With  that  information  he  would -enter  a  decision  making  guidance 
table  and  obtain  from  it  the  advice  codes  it  lists.  This  decision  aid  is  shown  in  Table  4  . 
When  the  code  indicates  anything  abnormal,  some  type  of  action  is  recommended. 
Normally  the  initial  action  is  to  request  a  red-tagged'  sample  and  to  cease  operation  of 
the  equipment.  The  red-tagged'  sample  is  to  gain  confirmation  of  the  abnormal  results 
before  any  type  of  maintenance  action  will  be  recommended.  If  abnormal  results  are 
confirmed,  the  supplemental  information  provided  in  the  technical  manual  is  consulted 
and  a  maintenance  action  is  recommended.  The  supplemental  information  may  be  very 
useful  in  pin-pointing  possible  problem  areas  and  identifying  a  specific  recommendation 
to  the  sample  originator  [Ref.  1:  p.  6-lj. 

An  example  of  the  above  procedure  using  the  tables  shown  is  given  here.  An  oil 
analyst  receives  a  sample  from  an  engine  that  was  previously  sampled  twenty  engine 
hours  earlier.  His  logbook  shows  that  its  last  sample  was  normal  and  had  values  as 
follows  (in  ppm):  Fe-10,  Ag-0,  Al-2,  Cr-0,  Cu-1,  and  Mg-1.  The  present  sample  is 
tested  with  the  following  results:  Fe-19,  Ag-4,  Ai-6,  Cr-0,  Cu-1,  and  Mg-1.  The  analyst 
determines  the  ten-hour  trend  values  to  be  (in  ppm, hour):  Fe-4.5,  Ag-2,  Al-2,  and  the 
remainder  zero.  Using  Table  3,  he  would  discover  Fe  and  Ag  to  have  abnormal  trends 
and  high  ranges,  with  all  other  elements  normal.  Entering  Table  4  in  the  high  range  in 
column  one  and  reading  across  through  the  normal  range  in  column  two  for  the 
previous  sample,  and  then  through  the  abnormal  trend  in  column  three,  one  obtains 
the  advice  code  P  from  column  four.  The  analyst  translates  this  code  as:  do  not 
fly  operate ;  do  not  change  oil ;  submit  sample  ASAP  and  relays  this  to  the  sample 
onginator.  The  red-tagged'  sample  is  subsequently  analyzed  for  verification  of  the  last 
results.  If  results  are  identical  to  the  previous  ones,  the  appropriate  advice  code  from 
column  five  is  utilized.  This  might  include  using  the  lower  part  of  Table  3  to  determine 
possible  maintenance  problems  such  as  the  power  turbine  shafts. 

B.  DISCUSSION  OF  DATA  USED 

The  data  in  this  analysis  was  obtained  from  a  field  test  for  the  evaluation  of  the 
Portable  Wear  Metal  Analyzer  that  was  conducted  in  1985.  The  data  was  collected 
over  a  two  month  period  from  four  locations:  NARF,  Pensacola,  Elmendorf  AFB, 
Langley  AFB,  and  Myrtle  Beach  AFB.  Both  Dash-3's  and  prototype  PWMA's  were  in 
the  laboratories  at  each  site  in  order  to  provide  data  for  their  comparisons.  Only  the 
nine  elements  that  the  PWMA  is  able  to  measure  were  recorded  for  the  Dash-3. 
Though  the  primary  objective  of  the  field  test  was  to  determine  the  functionality  of  the 
PWMA  [Ref.  10:  p.  l|,  the  data  obtained  easily  lent  itself  to  this  study. 
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SAMPLE  WEARME'IAL  EVALUATION  CRITERIA  AND  TREND  TABLE 
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As  designed,  the  test  called  for  each  site  to  use  six  graphite  tubes  for  160  sample 
'bums'  each.  Many  samples  were  to  be  tested  five  consecutive  times  when  analyzed. 
The  test  plan  was  designed  for  repetitive  four  day  cycles.  The  sequence  of  events  it 
followed  for  the  PWMA  is  shown  in  Table  5  (Ref.  10:  p.  11].  The  sequence  of  events 
for  the  Dash-3  was  nearly  identical  to  that  of  the  PWMA.  Consistency  in  following 
this  test  plan  varied  among  the  different  locations.  This  directly  affected  the  number  of 
sample  results  provided  by  each  location.  A  compilation  of  the  number  of  samples 
used  in  this  analysis  from  each  location  is  given  in  Table  6  . 


TABLE  5 

PWMA  FIELD  TEST  BURN  SEQUENCE 


Day  1  Calibration  Runs 

Verification  Samples 
Correlation  Samples  1,  2,  3 
Random  Samples 
Verification  Samples 

Dav  2  Reslope 

Verification  Samples 
Correlation  Samples  4,5 
Random  Samples 
Calibration  Check.  Samples 
Random  Samples 
Verification  Samples 

Day  3  Calibration  Samples 

Verification  Samples 
Correlation  Samples  6,7 
Random  Samples 
Verification  Samples 

Day  4  Reslope 

Verification  Samples 
Correlation  Samples  8,9 
Random  Samples 
Calibration  Check  Samples 


As  noted  in  Table  5,  there  were  four  main  classes  of  samples  tested  with  the 
instruments:  calibration,  verification,  correlation,  and  random  samples.  Calibration 
samples  of  MIL-L-7808  oil  were  used  for  the  internal  calibration  of  the  PWMA.  Three 
calibration  samples  containing  20%,  50%,  and  100%  respectively  of  full  scale  values 
for  all  nine  metals  were  used  for  the  calibration  runs  and  were  also  used  for  quality 
assurance  in  the  calibration  check  runs.  Verification  samples  were  made  in  MIL- 
L-7808  oil  and  contain  concentration  levels  of  10%,  40%,  and  70%  of  the  top  of  the 


TABLE  6 

NUMBER  OF  SAMPLES  USED  IN  ANALYSIS 


dynamic  range.  Correlation  samples  were  designed  to  reflect  the  pseudo-realism  of 
having  various  concentration  levels  for  each  element.  Nine  different  correlation 
samples  were  used  in  the  test.  Because  of  the  inavailabilitv  of  MIL-L-7808  oil  with 
significant  u'earmetal  levels  for  the  correlation  samples,  used  MIL-L-23699  turbine 
engine  oil  was  utilized  after  blending  with  organo-metallic  concentrates  as  necessary  by 
JOAP-TSC.  These  samples  were  ensured  to  contain  a  minimum  of  seven  wearmetals. 
The  random  samples  were  routine  daily  samples  obtained  at  each  site  and  were 
typically  MIL-L-7808  lubricants  from  the  Air  Force,  and  MIL-L-23699  lubricants  from 
the  Navy.  Reslopes  were  calibration  checks  using  a  50%  of  full  scale  calibration 
sample.  [Ref.  10:  p.  6] 

Due  to  the  nature  of  the  calibration  runs  and  the  low  values  in  the  random 
samples,  only  verification  and  correlation  samples  were  used  in  this  analysis.  This 
made  possible  a  total  of  twelve  samples,  consisting  of  three  different  verification  and 
nine  different  correlation  samples.  Sample  numbers  (or  levels  as  appropriate)  were 
kept  in  the  database  as  well  as  the  graphite  tube  number  in  which  a  sample  was  used 
for  later  use  in  determining  their  means.  Each  sample  bum'  with  the  PWMA 
correlation  samples  was  repeated  five  consecutive  times.  In  order  to  provide  a  one  to 
one  correspondence  of  data  between  the  instruments,  the  average  of  the  consecutive 
bums'  was  used  in  the  analysis.  The  PWMA  value  (average  value  for  correlation 
samples  or  actual  measurement  for  verification  samples  as  appropriate)  was  coupled 
with  its  counterpart  on  the  Dash-3  that  was  closest  in  time.  In  normal  cases  this  led  to 
results  such  as  pairing  the  fust  verification  sample  level  10'  measured  during  the  dnv 
from  each  instrument.  Differences  in  sample  sizes  for  the  various  element-location 
combinations  was  a  result  of  missing  data  points  and  the  removal  of  extreme  outliers 
from  the  data. 


IV.  ANALYSIS 


A.  OBJECTIVES 

The  objective  of  this  analysis  is  to  find  a  functional  relationship  between  Dash-3 
and  PWMA  measurements  for  the  nine  elements  that  the  PVVMA  measures.  Analysis 
of  variance  techniques  will  be  used  in  order  to  determine  what  effects  cause  significant 
differences  in  the  measurements  obtained.  Regression  analysis  will  be  used  to  yield  the 
parameters  of  an  equation  to  relate  the  instrument  measurements,  and  to  obtain  the 
standard  deviations  of  those  parameters.  The  coefficient  of  determination  or  r2  statistic 
will  be  used  as  a  measure  of  how  well  the  model  fits  the  data  and  to  compare  the 
different  models.  It  is  also  known  as  the  square  of  the  coefficient  of  determination  and 
represents  the  percentage  of  total  variation  explained  by  the  model. 

B.  SCATTERPLOTS 

Scatterplots  of  the  data  are  useful  in  determining  areas  for  further  investigation. 
They  were  used  in  this  analysis  to  provide  insight  into  the  rejection  of  the  hypothesis 
that  there  is  no  difference  in  measurements  due  to  location.  The  rejections  are 
described  in  the  analysis  of  variance  section.  The  scatterplots  in  Figures  4.1  -  4.9  are 
location  coded  and  mclude  all  verification  and  correlation  sample  data  points.  As 
reflected  in  Table  7,  examination  of  these  plots  show  Pensacola  with  higher  values  and 
Elmendorf  with  lower  values  for  most  elements  (seven  of  nine  in  each  case).  The 
consistent  extremes  shown  by  these  two  locations  are  a  primary  reason  for  differences 
found  between  locations.  The  number  of  samples  submitted  does  not  explain  the 
extremes  as  both  had  larger  sample  sizes.  Coded  scatterplots  of  the  graphite  tube 
furnaces  for  each  location/element  combination  are  shown  in  Appendix  A.  The  tubes 
were  reviewed  in  particular  because  they  were  prototypes  and  not  production  models. 
The  quality  controls  that  will  be  used  in  manufacturing  the  production  models  was  not 
used  for  the  prototypes,  consequently,  it  was  suspected  that  they  could  be  a  large 
source  of  variability  in  the  measurements.  The  graphite  furnace  tubes  were  provided  to 
each  site  with  the  tubes  labeled  sequentially  within  sites.  Some  tubes  mc'functior.ed 
and  could  not  be  used  due  to  calibration  failures,  causing  skips  in  the  tube  n  ameers 
reported.  Most  tubes  did  not  last  as  long  as  expected  originally  so  all  tubes  did  not 
have  an  equal  number  of  burns.  With  minor  exceptions,  no  unusual  characteristics 
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Figure  4.5  Location  Coded  Scattcrptot  of  Cu  Using  All  Points. 
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Figure  4.6  Location  Coded  Scattcrplot  of  Mg  Using  Ail  Points. 
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Figure  4.9  Location  Coded  Scatterplot  of  Ti  Using  All  Points. 


TABLH 7 

SUMMARY  OF  LOCATION  COULD  SCATTLRPLO  IS 
Element  Location  Coded  Results 


H  low 


L  low 


were  found.  A  summary  of  the  graphite  furnace  tubes  in  Table  8  shows  filmcndorf 
used  six  different  graphite  tubes  in  its  experiments  with  tube  1  measuring  higher  than 
normal  in  seven  elements,  tube  7  high  in  live  elements,  and  three  points  of  tube  5  high 
in  seven  elements  (indicated  by  5,).  Though  the  three  points  from  tube  5  appeared  to 
be  an  aberration,  they  were  included  in  the  analysis.  Higher,  lower  than  normal  is  not 


TABLE  8 

SUMMARY  OF  GRAPHITE  TUBE  CODED  SCATTERPLOTS 


Elm 

Lan 

Myr 

Pen 

Fe 

1,53,7  Hi 

5  Hi  7  Lo 

1  Hi 

Ag 

l,53  Hi 

3  Lo 

16  Hi 

A1 

1  Hi 

Cr 

l,5j  Hi 

1  Hi 

1  Hi 

Cu 

1,53  Hi 

3  Hi  7  Lo 

Mg 

7  Hi 

7  Lo 

Ni 

1,53,7  Hi 

Si 

53,7  Hi 

Ti 

1,53,7  Hi 

2  Lo 

1  Lo 

Tubes 

Used 

‘i?’4 

1,2,3, 5 

1,2, 3, 4 

5,6 

1 .3.4,5 
6.&A12 
lJ,f5  16 

used  in  a  statistical  sense  but  as  a  subjective  term.  A  symbol  that  characteristically 
plotted  as  a  maximum/minimum  value  across  the  range  of  x  values  was  given  the 
appropriate  subjective  term.  The  five  tubes  used  by  Langley  showed  tube  7  measuring 
low  in  three  elements,  tube  2  low  in  one,  and  tubes  1,  3,  and  5  high  in  one  element 
apiece.  Myrtle  Beach  used  six  tubes  and  showed  nothing  unusual  except  for  tube  3 
measuring  low  in  one  element.  Pensacola  provided  the  most  data  and  used  the  most 
tubes,  11.  Its  scatterplots  are  not  unusual  except  for  tube  1  being  high  for  two 
elements  and  low  for  on*,,  and  tube  16  being  high  for  one  element.  In  summary,  the 
scatterplots  indicate  that  the  locations  provide  different  measurements,  with  Pensacola 
normally  high,  and  Elmendorf  normally  low.  The  graphite  furnace  tubes  do  appear  to 
have  a  statistically  significant  difference  within  each  instrument,  but  not  a  practical 
difference. 


C.  ANALYSIS  OF  VARIANCE 


As  stated,  a  superior  tool  to  scatterplots  in  determining  if  various  effects  are 
statistically  significant  is  analysis  of  variance.  It  is  used  here  to  determine  if  the 
various  instruments  (the  four  prototype  PWMA's  and  the  four  Dash-3's)  are  providing 
measurements  close  enough  to  be  considered  not  statistically  different.  Examples  of 
the  various  ANOVA  models  applicable  can  be  found  in  References  11  and  12  .  Using 
the  standard  assumptions  of  normality,  an  alpha  level  of  significance  of  0.05  is  used 
throughout  this  paper.  Statistical  significance  obtained  may  be  more  restrictive  in  its 
determinations  than  what  would  be  considered  a  practical  significance  by  the  oil 
analysts.  In  other  words,  the  numbers  may  be  close  enough  to  be  considered  the  same 
by  the  analysts.  No  assertions  as  to  what  this  practical  significance  might  be  will  be 
addressed.  Analyses  of  variance  were  run  on  the  correlation  samples  to  determine  if 
location,  sample,  or  their  interaction  is  significant.  The  resulting  tables  and  associated 
p- values  are  given  in  Appendix  B.  As  summarized  in  Table  9,  location  differences 
were  found  with  all  elements  except  Ni  on  the  Dash-3.  Location-sample  interactions 
were  significant  with  four  elements  for  the  Dash-3,  and  in  all  but  two  elements  for  the 
PWMA.  These  results  imply  greater  variability  in  the  prototype  PWMA  instruments. 


TABLE  9 

SUMMARY  OF  CORRELATION  DATA  ANOVA 
PWMA  Dash-3 


LOC 

SAM 

INT 

1 

SAM 

INT 

Fe 

X 

X 

X 

1 

X 

X 

X 

Ag 

X 

X 

X 

X 

X 

A1 

X 

X 

X 

X 

X 

Cr 

X 

X 

X 

X 

X 

Cu 

X 

X 

X 

X 

X 

Mg 

X 

X 

X 

X 

X 

Ni 

X 

X 

X 

X 

Si 

X 

X 

X 

X 

X 

Ti 

X 

X 

1...X 

X 

X 

X 

X  denotes  statistically  significant  at  a  *  .05 


The  analyses  of  variance  on  the  verification  sample  data  for  both  instruments  is 
provided  with  their  corresponding  p-values  in  Appendix  C,  and  a  summary  given  m 
Table  10  .  Table  10  shows  that  when  interactions  were  considered,  location  was  not 
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significant  for  three  PWMA  elements  (Cu,  Si,  and  Ti)  and  one  Dash-3  element  (Ni). 
Analysis  of  interactions  showed  all  PWMA  elements  except  Mg  did  not  have 
significant  interactions,  while  all  Dash-3  elements  but  Ni  did  have  a  significant 
interaction.  In  contrast  to  the  correlation  data,  this  shows  a  strong  variability  in  the 

TABLE  10 

SUMMARY  OF  VERIFICATION  DATA  ANOVA 


PWMA  Dash-3 


Dash-3  compared  to  the  prototype  PWMA.  As  expected  and  designed,  the  different 
verification  levels  and  different  correlation  samples  were  significantly  different  within 
their  respective  groups.  Further  analysis  on  the  verification  data  is  summarized  in 
Table  11  ,  which  takes  a  closer  view  of  location  effects  at  each  of  the  three  levels. 
Recall  that  these  levels  represent  the  samples  which  contain  10,  40,  and  70  percent  of 
the  full  scale  dynamic  range  for  each  element.  The  table  gives  each  instrument's 
corresponding  element-level  matrix  of  significant  location  effects.  The  matrix  shows 
the  prototype  PWMA  to  be  very  consistent  in  its  measurements  across  locations  as 
opposed  to  the  Dash-3,  which  lacks  consistency  for  most  elements  and  levels.  The 
basis  for  this  statement  lies  in  the  few  holes  shown  in  the  Dash-3  matrix  and  the  few 
marks  in  the  PWMA  matrix.  Examination  of  location  effects  on  the  verification  data 
was  also  done  using  means.  The  highest  and  lowest  location  mean  was  recorded  for 
each  element  and  is  shown  in  Table  12  .  From  this  it  can  be  seen  that  a  location  that 
is  high(Iow)  for  an  element  is  usually  high(low)  for  all  three  levels  for  that  element.  Of 
interest  is  that  the  location  that  measures  high(low)  for  an  element  on  one  instrument 
will  not  normally  be  high(low)  on  the  other  instrument  as  well.  This  shows  an 


TABLE  11 

SUMMARY  OF  VERIFICATION  LEVEL  ANOVAS 


3 


X  denotes  statistically  significant  at  a  =  .05 


apparent  low  correlation  between  the  two  instruments  regarding  the  same  location 
being  high(low)  for  a  particular  element. 


TABLE  12 


VERIFICATION  LEVEL  HIGHEST  AND  LOWEST  MEANS 


PWMA 


Dash-3 


10  40 


Hi 
Fe  Lo 


Hi 

As  Lo 


Cr  Lo 


Hi 

Cu  Lo 


Hi 

Mg  Lo 


Hi 
Ni  Lo 


Hi 
Si  Lo 


Hi 
Ti  Lo 


D.  REGRESSION 


Regression  is  used  as  the  principal  tool  to  determine  functional  relationships 
(transformation  equations)  between  the  measurements  of  the  two  different  instruments. 
Tables  13-21  show  for  each  element  the  results  of  several  regressions  run  on  the  data. 
For  each  regression,  the  following  are  given:  r2,  the  intercept  and  its  standard 
deviation,  the  slope  and  its  standard  deviation,  and  the  number  of  data  points  used  in 
the  regression.  Two  principal  models  were  analyzed,  the  first  model  used  all  data 
points  from  all  locations  regardless  of  the  location  sample  sizes  (model  1);  and  the 
second  model  used  the  means  of  the  samples  and  levels  at  each  location,  thereby 
allowing  equal  sample  sizes  (model  2).  The  various  sample  sizes  were  presented  in 
Table  6  .  Appendix  D  gives  a  basic  regression  model.  The  majority  of  regressions 
done  used  the  simple  linear  model  of: 

PWMA  -  B0  +  B,(DASH-3)  +  e  .  (eqn  4.1) 

Other  regressions  used  a  quadratic  fit  or  used  simple  linear  fits  on  transformations  of 
the  data.  No  attempts  were  made  to  force  the  resulting  equations  through  the  origin. 

An  ideal  regression  using  the  simple  linear  model  with  least  squares  estimators 
has  a  high  r2  .  It  will  also  meet  the  assumption  of  constant  variance  across  the  range  of 
interest  (homoscedascity),  and  that  of  normalized  residuals.  The  usual  least  squares 
regression  estimators  have  optimal  properties  if  one  assumes  that  the  variance  of  the  y 
values  remains  constant  as  x  increases,  together  with 

E[y.]  =  a  +  bXj  .  (eqn  4.2) 

Many  measuring  instruments  have  variances  which  increase  with  the  magnitude  of  the 
quantity  measured.  Letting  <r2  represent  the  variance  of  yif  one  could  assume  a  simple 
linear  relation 

<r2  -  kXj  ,  (eqn  4.3) 

in  which  case  Equation  4.2  can  be  transformed  by  dividing  by  </x|  .  This  will  give  a 
constant  variance  model  and  help  to  normalize  the  residuals.  However,  this  procedure 
will  not  work  if  the  data  displays  a  variance  that  first  increases  and  then  decreases  as 
the  true  content  increases. 


TABLE  13 

REGRESSION  RESULTS  FOR  FE 


1 


! 

Elmendorf 

- — t 

.81 

-2.68 

Langley 

1-Lin 

.85 

-3.02 

i 

Myrtle  Beach 

1-Lin 

.96 

-4.57 

1 

Pensacola 

1-Lin 

•95 

-1.75 

( 

1 

All  Loc 

1-Lin 

.87 

-2.43 

u 


m 


LanMyrPen 


1-Lin  .92 


Corr  Means 

— 

2-Lin 

.87 

-.36 

1.64 

.507 

36 

Verif  Means 

2-Lin 

.97 

-9.76 

3.01 

.719 

.040 

12 

All  Loc  Means 

2-Lin 

i 

H 

1.59 

.570 

.028 

48 

LMP  Means 

2-Lin 

.96 

-2.09 

1.33 

.617 

.022 

36 

PWMA2-Dash-32 


PWMA-Dash-32 


PWMA2-Dash-3 


2-Lin 


2-Lin 


2-Lin 


‘-denotes  not  included  due  to  little  or  no  r2  improvement. 
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TABLE  14 

REGRESSION  RESULTS  FOR  AG 


i 


\ 


1 

Data 

! 

Model 

1 

r2 

! 

Bo 

"Bi 

n 

Elmendorf 

1-Lin 

.74 

.49 

.27 

.466 

.026 

118 

Langley 

1-Lin 

1 

.92 

-.37 

.26 

.574 

.022 

58 

1 

Myrtle  Beach 

1-Lin 

.88 

.22 

.32 

.535 

.028 

51 

Pensacola 

1-Lin 

.92 

.24 

.20 

.685 

.019 

117 

All  Loc 

1-Lin 

.82 

.29 

.15 

.559 

.014 

344 

LanMyrPen 

1-Lin 

.87 

.19 

.17 

.605 

.015 

229 

All  Loc 

.  .84 

* 

* 

♦ 

* 

344 

i  Corr  Means 

2-Lin 

.91 

.02 

.37 

.539 

.029 

1 

Verif  Means 

2- Lin 

.95 

-.45 

.38 

.690 

.050 

12 

All  Loc  Means 

2-Lin 

.91 

.11 

.30 

.542 

.025 

48 

LMP  Means 

2-Lin 

.91 

.16 

-  .  -  -  1 

.36 

.567 

.030 

36 

PWMA2-Dash-32 

2-Lin 

.81 

* 

* 

* 

* 

48 

2-Lin 

.76 

* 

* 

* 

* 

PWMA2-Dash-3 

2-Lin 

.83 

* 

* 

* 

* 

48 

•-denotes  not  included  due  to  little  or  no  r2  improvement. 
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TABLE  15 

REGRESSION  RESULTS  FOR  AL 


Data 

Model 

r2 

Bo 

— 

B! 

«Bi 

n  ! 

i 

Elmendorf 

1-Lin 

.60 

.88 

.428 

.032 

116 

Langley 

1-Lin 

.67 

1.65 

. 

1.00 

58 

1-Lin 

.80 

2.14 

.80 

.618 

.045 

48 

Pensacola 

1-Lin 

.59 

5.25 

.70 

.399 

.031 

118 

All  Loc 

.57 

3.19 

.44 

.442 

.021 

340 

Lan.YlyrPen 

1-Lin 

.31 

7.89 

.55 

.250 

.025 

231 

All  Loc 

.59 

* 

* 

* 

* 

340 

Corr  Means 

2- Lin 

.75 

3.21 

1.10 

.435 

.045 

34 

Verif  Means 

2- Lin 

.84 

1.00 

1.30 

.723 

All  Loc  Means 

2-Lin 

.75 

3.15 

.87 

.451 

LMP  Means 

2- Lin 

.79 

3.74 

.93 

34 

PWMA2-Dash-32 

2-Lin 

.65 

* 

* 

* 

* 

- 

46 

PWMA-Dash-32 

2-Lin 

.60 

* 

♦ 

* 

* 

46 

PWMA2-Dash-3 

2-Lin 

.69 

* 

* 

* 

* 

46 

TABLE  16 

REGRESSION  RESULTS  FOR  CR 


y{ 


f 

i - 

Elmendorf 

I 

Lanelev 
s"  - 

i 

f 

Myrtle  Beach 

\ 

Pensacola 

All  Loc 

1-Lin 

.83 

.12 

.711 

— 

.017 

345 

LanMyrPen 

1-Lin 

.93 

.03 

— 

.11 

.792 

1 

i 

All  Loc 


Corr  Means 


Verif  Means 


All  Loc  Means 


LMP  Means 


PWMA2-Dash-32 


PWMA-Dash-32 


PWMA2-Dash-3 


2- Lin 


2- Lin 


2-Lin 


2-Lin 


2-Lin 


2-Lin 


2-Lin 


.90 

.21 

.35  1 

.738 

.042 

.95 

-.23 

.33 

.873 

.060 

.90 

-.06 

.28 

.738 

.036 

.97 

-.29 

.20 

.822 

.026 

♦-denotes  not  included  due  to  little  or  no  r2  improvement. 


TABLE  17 

REGRESSION  RESULTS  FOR  CU 


TABLE  18 

REGRESSION  RESULTS  FOR  MG 


Data 

Bo 

<Tp 

B0 

B1 

*Bi 

n 

Elmendorf 

1-Lin 

.81 

-3.39 

.66 

.526 

.023 

116 

Langley 

1-Lin 

.85 

-3.12 

.99 

.647 

.036 

57 

Myrtle  Beach 

1-Lin 

.82 

-2.97 

1.15 

.586 

.040 

51 

Pensacola 

1-Lin 

.87 

.20 

.62 

.648 

.024 

115 

All  Loc 

1-Lin 

.76 

-1.70 

.49 

.578 

.018 

339 

LanMyrPen 

1-Lin 

.35 

-6.35 

.80 

.317 

.028 

231 

All  Loc 

1-Quac 

- 

* 

♦ 

* 

* 

339 

Corr  Means 

2-Lin 

.84 

-1.98 

1.53 

.584 

.046 

34 

Verif  Means 

2- Lin 

.80 

-2.65 

2.16 

.619 

.097 

12 

All  Loc  Means 

2-Lin 

.84 

-2.06 

1.19 

.587 

.038 

46 

LMP  Means 

2-Lin 

.84 

-1.57 

1.41 

.602 

.045 

34 

PWMA2-Dash-32 

2-Lin 

.79 

* 

_ 

* 

. 

* 

* 

46 

PWMA-Dash-32 

2-Lin 

.79 

♦ 

♦ 

* 

46 

PWMA2-Dash-3 

2-Lin 

.77 

♦ 

* 

* 

* 

46 

•-denotes  not  included  due  to  little  or  no  r2  improvement. 
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TABLE  19  - 

REGRESSION  RESULTS  FOR  NI 


Bo 

% 

B1 

“B, 

n 

.026  |  59 


.026  50 


Verif  Means 


All  Loc  Means 


LMP  Means 


PWMA2-Dash-32 


PWMA-Dash-32 


PWMA2-Du3U-J 


.92 

.88 

.65 

.569 

.029 

2-Lin 

.98 

-3.68 

.70 

.793 

.032 

2-Lin 

.92 

.18 

.59 

.603 

.026 

2-Lin 

.97 

.42 

.638 

2-Lin 


2-Lin 


2-Lin 


•-denotes  not  included  due  to  little  or  no  r2  improvement. 


1.  Regression  Using  All  Data  Points  Individually  (Model  1) 

Seven  different  regressions  were  run  where  all  data  points  from  all  locations 
were  used.  The  first  four  of  these  were  run  by  using  a  simple  linear  model  on  each 


TABLE  20  . 

REGRESSION  RESULTS  FOR  SI 


Data 

B0 

Bl 

n 

Elmendorf 

-.14 

.93 

.346 

.035 

115 

Langley 

1-Lin 

.66 

-.95 

1.08 

.452 

59 

Myrtle  Beach 

1-Lin 

.86 

-.91 

.55 

.337 

.019 

50 

Pensacola 

1-Lin 

.67 

-.17 

.63 

.400 

.026 

115 

All  Loc 

1-Lin 

.60 

-.31 

.43 

.375 

.017 

339 

LanMyrPen 

1-Lin 

.66 

-.28 

.48 

.394 

.019 

232 

All  Loc 

.61 

* 

* 

* 

* 

339 

Corr  Means 

2- Lin 

.82 

-1.01 

.65 

.298 

.024 

36 

Verif  Means 

2- Lin 

.94 

-1.11 

1.02 

.490 

.040 

12 

2-Lin 

.75 

-.67 

.74 

.329 

.027 

48 

LMP  Means 

2- Lin 

.77 

-.80 

.93 

.356 

.033 

36 

PWMA2-Dash-32 

2-Lin 

.67 

* 

♦ 

* 

* 

48 

PWMA-Dash-32 

2-Lin 

.68 

* 

* 

* 

* 

48 

PWMA2-Dash-3 

2-Lin 

.63 

* 

* 

* 

• 

48 

•-denotes  not  included  due  to  little  or  no  r2  improvement. 


location  and  the  data  then  used  to  gain  a  parametnc  understanding  of  the  scatterplots 
presented  earlier.  Non-parametric  results  in  Tables  22  -  24  were  derived  from  these 
regressions.  Table  22  ranks  the  slopes  for  each  element  by  location  and  shows 
Elmendorf  to  have  a  smaller  slope  with  six  of  the  nine  elements  (explaining  the  earlier 
scatterplot  results).  It  also  shows  Pensacola  to  have  a  higher  slope  than  the  other 
locations  in  five  of  the  elements.  The  rankings  of  the  standard  deviations  of  the  slopes 
are  given  in  Table  23  .  It  was  found  to  be  smallest  most  often  with  Pensacola,  with 
Elmendorf  exhibiting  the  second  smallest  standard  deviation.  Table  24  ranks  r2  and 
shows  Elmendorf  to  have  a  lower  r2  in  seven  of  the  nine  elements. 


TABLE  21 

REGRESSION  RESULTS  FOR  TI 


Data 

1 

!  Elmendorf 

B0 

"Bi 

.43 

.604 

.026 

.72 

.564 

.042 

PWMA2-Dash-3  2-Lin 


•-denotes  not  included  due  to  little  or  no  r2  improvement. 


The  remaining  three  regressions  were  used  to  determine  the  best  way  to  fit  the 
data  from  the  combination  of  locations.  A  combination  using  all  locations  except 
Elmendorf  was  investigated  because  of  Elmendorfs  significantly  smaller  slope.  For 
most  elements,  (all  except  A1  and  Mg),  r2  increased  when  Elmendorf  was  not  included. 
No  more  than  a  .02  improvement  was  gained  by  using  a  quadratic  regression  on  the 
data.  Because  of  this  small  gain,  it  was  decided  not  to  pursue  this  regression  model. 
Other  regression  variations  were  tried  in  the  sample  and  level  means  model  described 


TABLE  22  . 

RANK  OF  SLOPES  FOR  INDIVIDUAL  LOCATION  REGRESSIONS 


Fe 

Ag 

Al 

’ 

Cr 

Cu 

Mg 

Ni 

Si 

Ti 

Elm 

a 

D 

3 

D 

a 

a 

a 

3 

3 

Lan 

3 

2 

1 

3 

3 

2 

3 

a 

a 

Myr 

2 

3 

2 

2 

2 

3 

1 

4 

i 

Pen 

1 

1 

a 

1 

1 

1 

2 

2 

2 

_ 

Rankings  highest! I)  to  lowest(4) 


TABLE  23 

RANK  OF  SLOPE  STANDARD  DEVIATIONS  FOR  LOCATIONS 


Fe 

Al 

Cr 

Cu 

Mg 

Ni 

Si 

Ti 

3 

2 

2 

2 

1 

2 

3 

n 

Lan 

3 

2 

D 

2 

D 

3 

2 

D 

a 

Myr 

2 

D 

3 

D 

2 

D 

2 

D 

Pen 

1 

D 

1 

1 

n 

2 

D 

2 

Rankings  smallest!  1)  to  largest(4) 


TABLE  24 

RANK  OF  R2  FOR  LOCATION  REGRESSIONS 


F« 

BJ 

Al 

Cr 

_ 

Cu 

_ 

Mg 

Ni 

Si 

Ti 

Elm 

D 

a 

3 

D 

D 

a 

a 

D 

Lan 

3 

i 

2 

_ 

3 

3 

2 

3 

3 

a 

Myr 

1 

3 

a 

2 

1 

3 

1 

1 

i 

Pen 

2 

n 

a 

1 

2 

a 

a 

2 

Rankings  largest!  1)  to  smallest^) 


S3 


m 


i 


m 


m 

j 

■S5SI 


m 


c 


p 


CC 

i 


2.  Regression  Using  Sample  and  Level  Means  (Model  2) 

Due  to  the  disparity  in  the  number  of  samples  provided  by  each  location, 
(from  a  low  of  51  to  a  high  of  119),  a  method  was  needed  to  eliminate  the  skewing  of 
results  toward  the  locations  with  more  data  points.  By  taking  the  means  for  each  of 
the  three  verification  levels  and  of  the  nine  correlation  samples,  all  four  locations 
would  be  equally  weighted.  This  approach  allowed  a  total  of  twelve  means  (9 
correlation  and  3  verification)  to  be  provided  from  each  location.  Several  regressions 
were  conducted  using  this  approach.  Linear  regressions  were  conducted  on  the 
verification  level  means  alone,  the  correlation  sample  means,  on  the  combined  means, 
and  on  all  means  except  those  from  Elmendorf.  Linear  regressions  on  transformations 
of  the  combined  location  model  were  also  investigated.  From  Tables  13  -  21  ,  it  can  be 
seen  that  the  slopes  for  verification  level  regressions  were  often  high  in  comparison  to 
the  other  regressions.  The  low  number  of  data  points  (three  clusters  of  four  points 
each)  probably  contributed  to  this.  The  correlation  sample  means  regression  was  non¬ 
descript  and  quite  similar  to  the  regression  utilizing  model  1  for  many  of  the  elements. 
The  model  2  regressions  using  the  mean  values  from  all  locations  and  using  mean 
values  from  all  locations  but  Elmendorf  are  also  very  similar  to  their  counterpan  model 
1  regressions  that  utilize  all  points.  The  similarity  can  be  seen  in  the  summary  of 
equations  table  presented  in  Table  25  .  The  equations  shown  have  the  highest  r2  for 
each  respective  model.  The  supporting  data  either  consisted  of  data  from  all  locations 
or  all  locations  except  Elmendorf  (indicated  by  LMP).  The  r2  values  using  the  means 
(model  2)  is  greater  than  or  equal  to  those  obtained  using  all  points  (model  1)  in  every 
instance.  Improvements  to  the  r2  values  were  investigated  through  three  linear  models 
which  used  transformations  of  the  data,  these  were: 


PWMA2  =  B0  +  Bj Dash-32  +  e  , 


(eqn  4.4) 


PWMA  -  B0  +  BjDash-32  +  e  , 


(eqn  4.5) 


PWMA2  -  Bn  +  B,  Dash-3  +  e  . 


(eqn  4.6) 


Throughout  all  of  the  regressions,  a  recurring  problem  of  violating  basic  model 
assumptions  was  observed.  This  is  not  to  imply  the  equations  are  not  unbiased 
estimators,  but  only  that  they  may  not  be  the  best  estimators. 

The  common  data  transformation  technique  descnbed  at  the  beginning  of  the 
section  was  attempted  but  it  had  little  success  in  normalizng  residuals  or  gaining 
constant  variance.  Four  elements  (Al,  Cr,  Ni,  and  Ti)  did  attain  a  constant  variance, 
and  five  elements  (Fe,  Al,  Cr.  Mg,  and  Ti)  achieved  normalized  residuals.  Only  the 
elements  Al  and  Cr  met  both  assumptions  of  constant  variance  and  normalized 
residuals.  With  only  two  elements  meeting  both  assumptions  and  four  others  meeting 
only  one  after  using  the  transformation  derived  from  Equation  4.3,  it  was  decided  not 
to  pursue  the  transformation  farther.  This  decision  was  supported  by  taking  into 
account  the  small  improvement  gained  in  meeting  the  assumptions  at  the  expense  of 
the  complexities  that  would  be  introduced  into  the  equations  for  the  oil  analyst. 

TABLE  25 

REGRESSION  EQUATIONS  FOR  MODEL  1  AND  MODEL  2 


1-All  Points 


P  =  -2.47  +  .637D 


19+.605D 


P  =  3.19  +  .442D 


.03  +  .792D 


P  =  -2.73  +  .713D 


P--1.70+.578D 


.05  +  .65  ID 


28  +  .394D 


.02  +  .609D 


LMP  .92 


LMP  .87 


P  .93 


LMP  .89 


All 


LMP 


LMP  .66 


2- Means 


P  =  -2.09  +  .617D 


16  +  .567D 


.29+.822D 


P=  -2.40+  699D 


P**  -2.06  +  .587D 


=  -  .80+.356D 


p-  3.74  +  . 482D 

LMP 

r 

|  .7 

9 

LMP 


LMP 


All 


V.  SUMMARY  AND  CONCLUSIONS 


The  Joint  Oil  Analysis  Program  has  reached  an  important  milestone  with  the 
addition  of  the  Portable  Wear  Metal  Analyzer.  Strong  relationships  were  shown  to 
exist  by  this  analysis  between  the  measurements  taken  by  the  prototype  PWMA  and 
the  A  E35L-3.  The  analysis  was  based  on  data  from  a  1985  field  evaluation  of 
prototype  PWMAs.  Although  the  data  was  not  obtained  in  a  consistent  fashion  by  the 
laboratories,  it  was  useful  in  determining  accuracy  within  and  between  the  laboratories. 
A  subsequent  analysis  similar  to  this  one  is  merited  when  production  PWMAs  and 
supporting  parts  are  in  use.  The  equations  below  describe  the  best  estimate  of  the 
relationship  between  the  Dash-3  and  prototype  PWMA  readings.  The  equations  could 
be  used  in  making  conversions  from  the  JOAP  Laboratory  Manual.  Any  values  that 
result  in  a  negative  translation  should  be  regarded  as  zero. 

TABLE  26 

RECOMMENDED  EQUATIONS  FOR  A/E35U-3  TO  PWMA  CONVERSIONS 


Fe 

PWMA  *  -2.09  +  ,6I7(Dash-3) 

A| 

PWMA  =  .16  +  ,567(Dash-3) 

1  A1 

i  . 

PWMA  =  3.74  +  ,482(Dash-3) 

. 

Cr 

PWMA  =  -  .29  +  ,822(Dash-3) 

Cu 

PWMA  =  -2.40  +  .699(Dash-3) 

Mg 

PWMA  -  -2.06  +  ,587(Dash-3) 

Ni 

PWMA  =  .37  +  .638(Dash-3) 

Si 

PWMA  =  -  .80  +  .356(Dash-3) 

o 

PWMA  -  -  .03  f  .618(Dash-3) 

The  equations  presented  are  unbiased  estimators  when  a  simple  linear 
relationship  is  assumed  (although  they  do  contain  violations  of  homoscedascity  and 
normalized  residuals).  The  ability  of  the  equations  to  describe  the  data  varied,  but 


seven  of  the  nine  elements  had  r2  values  above  .80.  (A1  at  .79  and  Si  at  .77  were  the 
exceptions).  These  values  were  obtained  using  prototype  instruments  that  were  using 
prototype  graphite  furnace  tubes  and  were  therefore  considered  quite  good.  One  of  the 
four  locations  consistently  had  a  slope  less  than  the  others,  causing  it  to  be  dropped 
from  the  final  analysis  for  seven  of  the  elements.  This  improved  the  r2  values  in  each 
of  those  elements. 

Items  that  may  have  influenced  the  data  used  included  the  non-production 
graphite  furnace  tubes,  the  particle  size  capabilities  of  each  instrument,  the  nature  of 
the  correlation  samples,  and  the  several  factors  mentioned  in  Chapter  II.  The  furnace 
tubes  were  found  to  have  statistically  significant  differences  at  each  of  the  locations, 
but  they  did  not  appear  to  have  a  practical  difference  for  the  oil  analyst.  Further 
analysis  using  production  model  tubes  will  serve  to  clarify  this  area.  In  regards  to 
particle  size,  the  Dash-3  can  only  measure  particles  less  than  ten  micrometers  in  size, 
while  the  PWMA  can  measure  particles  up  to  twenty  micrometers.  It  can  be  deduced 
from  this  that  the  PWMA  Dash-3  functional  relationship  is  directly  dependent  on 
particle  size.  Therefore  a  sample  with  all  particles  less  than  ten  micrometers  in  size 
should  show  a  very  strong  relationship  between  instruments.  However,  it  is  possible 
for  a  sample  to  contain  a  majority  of  its  particles  in  the  ten  to  twenty  micrometer 
range  (or  higher)  and  thereby  yield  readings  not  consistent  with  the  equations  derived. 
The  correlation  samples  were  manufactured  using  a  blend  of  oils  and  enriched  with 
powdered  organo-metallic  concentrates  to  obtain  measureable  wearmetal  levels.  The 
room  for  inconsistencies  due  to  the  type  oil  used  for  instrument  calibration  with  the 
type  in  the  correlation  sample,  and  due  to  particle  sizes  in  the  samples  leaves  this  as  an 
area  for  further  scrutiny. 


APPENDIX  A 

GRAPHITE  TUBE  CODED  SCATTERPLOTS 
OF  VERIFICATION  AND  CORRELATION  SAMPLES 
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Figure  A.  1  Graphite  Tube  Scatterplot-Location:Elmc:idorf-Flement:Fe. 
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figure  A. 6  Graphite  Tube  Seattcrpiot-Location:Llmer.dorf-Clemcnt:Mg. 
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f  igure  A. 7  Graphite  Tube  Scattcrplot-Location:f lmendorf-L lcment:\i. 
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Figure  A.  10  Graphite  Tube  Scatterplot-Location:Langley-Element:Fc. 
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Figure  A.l  l  Graphite  Tube  Scatterplot-Location:l.angley-Element:Ag. 
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Figure  A. 24  Graphite  Tube  Scatterplot-Location:\lyrtle  Beach-Element:\Ig. 


Figure  A. 25  Graphite  Tube  Scatterplot-Location:\1yrtle  Bcach-Clcnient:Ni. 
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Figure  A. 33  Graphite  l  ube  ScatterpIot-Location:Pensacola-Llement:Mg. 
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APPENDIX  B 

ANOVA  TABLES  FOR  CORRELATION  DATA 


TABLE  27 

PWMA  CORRELATION  DM  A  ANOVA  TABLES 


PWMA 

ELEMENT.  PE 

SOURCE 

OF 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

3 

2166.66 

722.11 

65.83 

0.0001 

SAM 

8 

38909 . 09 

7563.63 

671.15 

0  .  0001 

LOCXSAM 

24 

1980.91 

82.  S3 

7.52 

0.0001 

ERROR 

143 

1568.95 

10.97 

TOTAL 

171 

64625.63 

R-SOUARE 

0.973 

PWMA 

ELEMENT.  AO 

SOURCE 

DP 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

S 

97  .45 

52.47 

18.43 

0. 0001 

SAM 

s 

5686.02 

460.75 

267.36 

0 . 0001 

LOCXSAM 

24 

71.45 

2.97 

1  .73 

0.0265 

ERROR 

144 

248.16 

1.72 

TOTAL 

179 

4103.07 

R-SOUARE 

0.939 

PWMA 

ELEMENT.  AL 

SOURCE 

OF 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

S 

368.81 

122  93 

9.63 

0.0001 

SAM 

t 

6575.13 

821.89 

64.36 

0.0001 

LOCXSAM 

25 

796.68 

34.63 

2.71 

0.0002 

ERROR 

146 

1864.51 

12.77 

TOTAL 

180 

9605.16 

R'SQUARE 

0.803 

PWMA 

ELEMENT.  CR 

SOURCE 

OF 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

5 

140.66 

66.88 

66.57 

0.0001 

SAM 

1 

1900.06 

257.50 

337.21 

0.0001 

LOCKS AH 

24 

54.32 

2.24 

3.21 

0.0001 

ERROR 

145 

102.12 

0.70 

TOTAL 

180 

2197.18 

R-SOUARE 

0.9S3 

PWMA 

ELEMENT.  CU 

SOURCE 

DP 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

3 

2220.14 

740.04 

29.82 

0.0001 

SAM 

8 

34714.56 

4359.52 

174.84 

0.0001 

LOCXSAM 

24 

277.10 

11.54 

0.47 

0.9844 

ERROR 

144 

3573.96 

24.81 

TOTAL 

179 

40785.78 

R-SQUARE 

0.912 

PWMA 

ELEMENT .  MO 

SOURCE 

DP 

ANOVA  SS 

MEAN  SO 

P  VALUE 

PR  >  F 

LOC 

3 

574.60 

124.86 

26.14 

0.0001 

SAM 

8 

16900.49 

2112.56 

442.23 

0.0001 

LOCXSAM 

24 

723.43 

30.14 

6.31 

0.0001 

ERROR 

142 

678.34 

4.77 

TOTAL 

177 

18676.88 

R-SOUARE 

0.965 

PWMA 

ELEMENT.  Nt 

SOURCE 

OP 

ANOVA  SS 

MEAN  SO 

P  VALUE 

PR  >  F 

LOC 

3 

557.60 

185.86 

79.51 

0.0001 

SAM 

8 

10538.83 

1317.35 

563.55 

0.0001 

LOCXSAM 

24 

51.21 

2.13 

091 

0.3846 

ERROR 

146 

341.28 

2.33 

TOTAL 

181 

11466.95 

R-SOUARE 

0.970 

PWMA 

ELEMENT.  SI 

SOURCE 

DP 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

3 

154.30 

5145 

7.00 

0.0002 

SAM 

8 

5616.72 

702.09 

95.34 

a. oaoi 

LOCXSAM 

24 

283.16 

11.79 

1.61 

0.0473 

ERROR 

143 

1030.80 

7.  J4 

TOTAL 

178 

7104.99 

R-SOUARE 

0.852 

PWMA 

ELEMENT.  TI 

SOURCE 

OF 

ANOVA  SS 

MEAN  SO 

P  VALUE 

PR  >  F 

LOC 

3 

186 . 14 

62.04 

51.98 

0.0001 

SAM 

8 

2875.53 

339.44 

301.10 

0.0001 

LOCXSAM 

24 

118.79 

4.94 

4.13 

0.0001 

ERROR 

144 

171.90 

1.19 

TOTAL 

179 

3332.37 

R-SOUARe 

0.944 

TABU;  28 

DAS  11-3  CORRELATION  DATA  ANOVA  TABLES 


DASH-S 

ELEMENT  FE 

SOURCE 

OF 

ANOVA  S3 

mean  so 

F  VALUE 

FR  >  F 

LOC 

3 

1011.11 

337.03 

17.25 

0  0001 

SAM 

S 

208611.88 

26076  48 

1334.93 

0 . 0001 

LOCXSAM 

24 

1394.88 

58.12 

2.98 

0 . 0001 

ERROR 

145 

2832.42 

19.53 

total 

ISO 

213830.30 

R-SOUARE 

0.984 

BASH-3 

ELEMENT  t  AQ 

SOURCE 

OF 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

3 

415.53 

138.51 

6  3  16 

0  0001 

SAM 

S 

11078 . 53 

1384.81 

631.43 

0  0001 

LOCXSAM 

24 

0  .  00 

0  .  0 

0  00 

1 . 0000 

ERROR 

147 

322.39 

2.19 

TOTAL 

182 

11777 . 04 

R-SOUARE 

0.972 

BASH-3 

ELEMENT:  AL 

SOURCE 

DF 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

3 

1303.70 

434.56 

45.41 

0 . 0001 

SAM 

8 

32746 . 02 

4093.25 

429  58 

0 .0001 

LOCXSAM 

23 

0  .  00 

0 . 0 

0.00 

1 . 0000 

ERROR 

147 

1400.68 

9.52 

TOTAL 

181 

34753.14 

R-SOUARE 

0.95? 

DASH-3 

ELEMENT.  CR 

SOURCE 

DF 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

3 

85.48 

28.49 

73.01 

0  0001 

SAM 

8 

3730.40 

446.30 

1194.68 

0.0001 

LOCXSAM 

24 

0.00 

0.0 

0.00 

1 . 0000 

ERROR 

147 

57.37 

0.39 

TOTAL 

182 

3816.10 

R-SQUARE 

0.984 

DASH-3 

ELEMENT.  CU 

SOURCE 

OF 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

3 

346.24 

182.08 

13.02 

0.0001 

SAM 

8 

76723.17 

9590.39 

685.78 

0.0001 

LOCXSAM 

24 

612.88 

25.53 

1.83 

0.0163 

ERROR 

143 

2027.76 

13.98 

TOTAL. 

180 

79910.06 

R-SOUARE 

0.974 

DASH-3 

ELEMENT.  MG 

SOURCE 

DF 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

3 

1006.78 

335.59 

39.65 

0.0001 

SAM 

8 

42531.7? 

5316.47 

628.18 

0.0001 

LOCXSAM 

22 

273.61 

12.43 

1.47 

0.0935 

ERROR 

144 

1218.71 

8.46 

TOTAL 

177 

45030.90 

R-SOUARE 

0.972 

DASH-3 

ELEMENT.  HI 

SOURCE 

DF 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

3 

13.38 

4.46 

1.19 

0.3151 

SAM 

8 

32406.82 

4050.85 

1081.77 

0.0001 

LOCXSAM 

24 

240.12 

10.00 

2.67 

0.0002 

ERROR 

146 

546.72 

3.74 

TOTAL 

181 

33207.05 

R-SOUARE 

0.985 

DASH-3 

ELEMENT.  SI 

SOURCE 

DF 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

3 

985.45 

328.48 

29.05 

0  0001 

SAM 

8 

31603.95 

6540.49 

570.40 

0.0001 

LOCXSAM 

24 

0  .  00 

0.00 

0.00 

1 . 0000 

ERROR 

143 

1639.75 

11.30 

TOTAL 

180 

54103.80 

R-SOUARE 

0.969 

DASH-3 

ELEMENT.  TI 

SOURCE 

DF 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

3 

110.31 

34.77 

14.72 

0  0001 

SAM 

8 

7895.61 

986.95 

395.05 

0.0001 

LOCXSAM 

24 

116.12 

4.83 

1.94 

0 . 0093 

ERROR 

144 

359.75 

2.49 

TOTAL 

17? 

8481.80 

b9 


APPENDIX  C 

ANOVA  TABLES  FOR  VERIFICATION  DATA 


TABLE  29 

PU  MA  VERIFICATION  DATA  ANOVA  TABLES 


PWMA 

ELEMENT.  PE 

SOURCE 

DP 

ANOVA  SS 

MEAN  SO 

P  VALUE 

PR  >  P 

LOC 

5 

86? ■ 53 

289.94 

5.20 

0.0021 

LEV 

2 

86477.45 

43338.72 

777.30 

0.0001 

LuC*LEV  t 

339.91 

56.65 

1.02 

0.4171 

ERROR 

ISO 

8363.29 

55.75 

TOTAL 

161 

96250 . 50 

R-SOUARE 

0.913 

pwm 

ELEMENT.  AC 

SOURCE 

OP 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  P 

IOC 

J 

10.12 

3.37 

3.64 

0.0143 

IEV 

z 

11S3.Q4 

576.52 

621 . 30 

0.0001 

LOCUEV  6 

7  .  02 

1.17 

1.26 

0.27*7 

ERROR 

152 

141 . 04 

0.92 

total 

16S 

1311.23 

R-SOUARE 

0.892 

Run  a 

ELEMENT.  AL 

SOURCE 

DP 

ANOVA  SS 

MEAN  SO 

P  VALUE 

PR  >  F 

toe 

3 

289.79 

96 . 59 

6.91 

0.0003 

LEV 

2 

4884.17 

2442.08 

174.66 

0.0001 

LOC»LEV 

6 

161.25 

26.87 

1.92 

0.0809 

ERROR 

US 

2069.38 

13.98 

TOTAL 

ISO 

7406.59 

R-SOUARE 

0.720 

PUMA 

ELEMENT.  CR 

SOURCE 

OF 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  P 

LOC 

S 

11.60 

3.86 

5.94 

0.000* 

LEV 

2 

950.14 

475.42 

753.27 

0.0001 

LOCILEV 

6 

4.06 

0.67 

1.04 

0.4011 

ERROR 

1S2 

91.55 

0.64 

total 

165 

1065.04 

R-SOUARE 

0.907 

pun  a 

ELEMENT.  CO 

SOURCE 

OF 

ANOVA  SS 

MEAN  SO 

P  VALUE 

PR  >  F 

LOC 

3 

15.62 

4.54 

0.41 

0.7460 

LEV 

Z 

12199.09 

6099.54 

557.39 

0.0001 

LOCRIEV 

6 

0.00 

0.00 

0.00 

1.0000 

ERROR 

151 

1652.41 

10.94 

TOTAL 

162 

15*40.60 

R-SOUARE 

0.1*1 

PUMA 

ELEMENT.  MG 

SOURCE 

DP 

ANOVA  SS 

MEAN  SO 

P  value 

PR  >  F 

LOC 

s 

771.97 

257.35 

44.53 

0.0001 

LEV 

z 

5657.29 

2028.64 

4*9.55 

0.0001 

LOCRLEV 

6 

355.27 

92.21 

15.94 

0.0001 

ERROR 

151 

872.61 

3.77 

TOTAL 

162 

7855.01 

R-SOUARE 

0 .  *69 

PUMA 

ELEMENT.  NZ 

SOURCE 

OP 

ANOVA  5 3 

MEAN  SO 

P  VALUE 

PR  >  P 

LOC 

5 

54.76 

11.58 

3.02 

0.0311 

LEV 

2 

9225.54 

4412.68 

1203.69 

0.0001 

LOCRIEV 

6 

14.04 

2.67 

0.70 

0.6516 

ERROR 

152 

982.5* 

5.85 

TOTAL 

165 

9*5*. 54 

R-SOUARE 

0.941 

PUMA 

ELEMENT.  SZ 

SOURCE 

OP 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  P 

LOC 

S 

144 .85 

48. 27 

2.20 

0.0894 

LEV 

2 

6687.15 

5545.57 

152.14 

0.0001 

LOCRIEV 

6 

130.66 

21.77 

0.99 

0.4355 

ERROR 

US 

3252.01 

21.97 

TOTAL 

15? 

10214.74 

R-SOUARE 

0.6*1 

PUMA  1 

ELEMENT.  TZ 

SOURCE 

OP 

ANOVA  SS 

MEAN  SO 

P  VALUE 

PR  >  P 

LOC 

} 

0.17 

2.72 

0 . 96 

0.4144 

LEV 

2 

4170.26 

2085.15 

755.55 

0. 0001 

LOCRLEV 

6 

15.93 

2.65 

0.94 

0.4704 

ERROR 

151 

428 . 05 

2.85 

TOTAL 

162 

4622.41 

R-SOUARE 

0.907 
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TABLE  30 

DASH-3  VERIFICATION  DATA  ANOVA  TABLES 


DASH-J 

ELEMENT :  FE 

SOURCE 

DF 

ANOVA  SS 

MEAN  SQ 

F  VALUE 

PR  >  F 

LOC 

3 

254.58 

84.86 

2.88 

0.0376 

L  £V 

2 

172498.44 

86248  22 

2922.57 

0.0001 

LOCXLEV 

6 

680 . 95 

113.49 

3.85 

0 .0015 

ERROR 

ISO 

4426.71 

29 . 51 

TOTAL 

161 

177860.69 

R-S8UARE 

0.973 

DASH-3 

ELEMENT-.  AC 

SOURCE 

DF 

ANOVA  SS 

MEAN  SQ 

F  VALUE 

PR  >  F 

LOC 

3 

96.23 

32.07 

55.93 

0.0001 

LEV 

2 

2202.02 

1101.01 

1919.82 

0.0001 

LOCUEV 

6 

24.95 

4.15 

7.25 

0.0001 

ERROR 

152 

87  .  17 

0.57 

TOTAL 

163 

2410.39 

R-SQUARE 

0.964 

DASH-3 

ELEMENT-  AL 

SOURCE 

DF 

ANOVA  SS 

MEAN  SO 

F  VALUE 

PR  >  F 

LOC 

3 

264.38 

88.12 

38.56 

0.0001 

LEV 

2 

9322.24 

4661 . 12 

2028.82 

0.0001 

LOCXLEV 

6 

59.32 

9.85 

4.30 

0.0005 

ERROR 

148 

340.02 

2.29 

TOTAL 

159 

9985.97 

R-SQUARE 

0.966 

DASH-3 

ELEMENT.  CR 

SOURCE 

DF 

ANOVA  SS 

MEAN  SQ 

F  VALUE 

PR  >  F 

LOC 

3 

14.89 

4.96 

27 .36 

0.0001 

LEV 

2 

1248.38 

624.19 

3438.30 

0.0001 

LOCXLEV 

6 

4.64 

0.77 

4.27 

0.0005 

ERROR 

152 

27.59 

0.18 

TOTAL 

163 

1295.53 

R-SQUARE 

0.979 

DASH-3 

ELEMENT.  CU 

SOURCE 

OF 

ANOVA  SS 

MEAN  SQ 

F  VALUE 

PR  >  F 

LOC 

3 

119.39 

39.79 

8.64 

0.0001 

LEV 

2 

29005.61 

14502.80 

3147.40 

0.0001 

LOCXLEV 

6 

77.80 

12.98 

2.82 

0.0126 

ERROR 

151 

693.77 

4.60 

TOTAL 

162 

29090.66 

R-SQUARE 

0.977 

DASH-3 

ELEMENT.  MO 

SOURCE 

0  f 

ANOVA  SS 

MEAN  SQ 

F  VALUE 

PR  >  F 

LOC 

3 

386.94 

128.90 

34.46 

0.0001 

LEV 

2 

14792.03 

7396.01 

1975.99 

0.0001 

LOCXLEV 

6 

76.43 

12.73 

3.40 

0.0055 

ERROR 

151 

565.10 

3.74 

TOTAL 

162 

15020.60 

R-SQUARE 

0.964 

DASH-3 

ELEMENT.  HI 

SOURCE 

DF 

ANOVA  SS 

MEAN  SQ 

F  VALUE 

PR  >  F 

LOC 

5 

12.04 

4.01 

2.02 

0.1120 

LEV 

2 

14923.80 

7461.94 

3752.34 

0.0001 

LOCXLEV 

6 

22.70 

3.70 

1.90 

0.0838 

ERROR 

152 

302.26 

1.98 

TOTAL 

163 

15260.90 

R-SQUARE 

0.900 

DASH-3 

ELEMENT.  SI 

SOURCE 

DF 

ANOVA  SS 

MEAN  SQ 

F  VALUE 

PR  >  F 

LOC 

3 

285.40 

95.16 

10.28 

0.0001 

LEV 

2 

25559.84 

12779.92 

1380.22 

0.0001 

LOCXLEV 

6 

228.78 

38.13 

4.12 

0.0007 

ERROR 

148 

1370.37 

9.25 

TOTAL 

159 

27444.49 

R-SQUARE 

0.950 

DASH-3 

ELEMENT.  TI 

SOURCE 

DF 

ANOVA  SS 

MEAN  SQ 

F  VALUE 

PR  >  F 

LOC 

3 

98 . 08 

32.69 

13.81 

0.0001 

LEV 

2 

8596.55 

4298.27 

1816.22 

0.0001 

LOCXLEV 

6 

36.29 

6  .  04 

2.56 

0.0219 

ERROR 

151 

357.35 

2. 36 

TOTAL 

162 

9088.29 

R-SQUARE 

0.961 

APPENDIX  D 
REGRESSION  MODEL 


The  primary  regression  model  used  in  this  paper  was  the  simple  linear  regression 
model  with  least  squares  estimators.  The  equation  yielded  from  this  model  will  give  the 
best  linear  unbiased  estimates  for  the  data  when  all  assumptions  are  met.  The  general 
straight  line  regression  model  is  given  in  Equation  D.I  . 


>j  =  a  +  b\j  +  Cj  .  (eqn  D.I) 

The  assumptions  used  for  this  model  are  I  Ref.  11:  p.  465]: 

1)  (ft’  have  a  population  of  y  values  for  each  x-\  the  population  variable 
corresponding  to  x-  is  _i  ■  . 

2)  El  T,l  -  <t  +  bx -for  each  x-(F\e =  0). 

.5)  !'«>•[  Y  )  =  <T“  for  each  x-  (hontoscedascity). 

4)  The  errors  of  observation,  e  ■  =  y-  -  a  -  hx-  are  uncorrelated. 

Solutions  to  the  regression  model  are  obtained  through  least  squares  estimation 
techniques.  The  resultant  equations  that  provide  the  estimates  arc: 


Vf x-  -  x)(y;  -  ") 

liXi-S)’’- 


where 


and 


(eqn  D.2) 


(eqn  D.i) 


(eqn  D.4) 


(eqn  D.5) 


The  variance  estimates  are: 
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